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Abstract 



, This paper proves that contractive ordinary differential equation systems 

remain contractive when diffusion is added. Thus, diffusive instabilities, in 
, the sense of the Turing phenomenon, cannot arise for such systems. An 

important biochemical system is shown to satisfy the required conditions. 

>: 

. 1 Introduction 

(N 

m i 

In this work, we study reaction-diffusion PDE systems 

od 

O: u t = F(u) + DAu 

as well as their discrete analogues ( "compartmental-systems" ) . Here, 

X; u(u,t) = (ui(oj,t),...,u n (oj,t)), u t = \~^f'--^~^f) ' 

A is the Laplacian operator on a suitable spatial domain f2, and no flux (Neu- 
mann) boundary conditions are assumed. 

In biology, a PDE system of this form describes individuals (particles, chemical 
species, etc.) of n different types, with respective abundances v,i(uj,t) at time 
t and location uj € fi, that can react instantaneously, guided by the interaction 
rules encoded into the vector field F, and can diffuse due to random motion. 
Reaction-diffusion PDE's play a key role in modeling intracellular dynamics and 
protein localization in cell processes such as cell division and eukaryotic chemo- 
taxis (e.g., [U El EJ Hj ) as well as in the modeling of differentiation in multi-cellular 
organisms, through the diffusion of morphogens which control heterogeneity in 
gene expression in different cells (e.g. [5j|6]). From a bioengineering perspective, 
reaction-diffusion models can be used to model artificial mechanisms for achieving 
cellular heterogeneity in tissue homeostasis (e.g., 0[8]). 
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The "symmetry breaking" phenomenon of diffusion-induced, or Turing, instabil- 
ity refers to the case where a dynamic equilibrium u of the non-diffusing ODE 
system ut = F(u) is stable, but, at least for some diagonal positive matrices 
D, the corresponding uniform state u{uo) = u is unstable for the PDE system 
ut = F{u) + DAu. This phenomenon has been studied at least since Turing's 
seminal work on pattern formation in morphogenesis [9], where he argued that 
chemicals might react and diffuse so as result in heterogeneous spatial patterns. 
Subsequent work by Gierer and Meingardt [lOj |TT] produced a molecularly plau- 
sible minimal model, using two substances that combine local autocatalysis and 
long-ranging inhibition. Since that early work, a variety of processes in physics, 
chemistry, biology, and many other areas have been studied from the point of 
view of diffusive instabilities, and the mathematics of the process has been ex- 
tensively studied P2J H3J HH HQ QSJ El HBl El 11^ - Most past work has focused 
on local stability analysis, through the analysis of the instability of nonuniform 
spatial modes of the linearized PDE. Nonlinear, global, results are usually proved 
under strong constraints on diffusion constants as they compare to the growth of 
the reaction part. 

In this note, we are interested in conditions on the reaction part F that guarantee 
that no diffusion instability will occur, no matter what is the size of the diffusion 
matrix D. We show that if the reaction system is "contractive" in the sense 
that trajectories globally and exponentially converge to each other with respect 
to a diagonally weighted LP norm, then the same property is inherited by the 
PDE. In particular, if there is an equilibrium F(u) = 0, it will follow that this 
equilibrium is globally exponentially stable for the PDE system. A similar result 
is also established for a discrete analog, in which a set of ODE systems are 
diffusively interconnected. We were motivated by the desire to understand the 
important biological systems described in [201 I2T] for which, as we will show, 
contractivity holds for diagonally weighted L 1 norms, but not with respect to 
diagonally weighted LP norms, for any 1 < p < oo. 

Closely related work in the literature has dealt with the synchronization problem, 
in which one is interested in the convergence of trajectories to their space aver- 
ages in weighted L 2 norms, for appropriate diffusion coefficients and Laplacian 
eigenvalues, specifically [22], which used passivity ideas from control theory for 
systems with special structures such as cyclic systems, [23] which extended this 
approach to more general passive structures, and [23] which obtained a general- 
ization involving a contraction-like diagonal stability condition. Our work uses 
very different techniques, from nonlinear functional analysis for normed spaces, 
than the quadratic Lyapunov function approaches, appropriate for Hilbert spaces, 
followed in these references. 

2 Logarithmic Lipschitz constants and norms 

We start by reviewing several useful concepts from nonlinear functional analysis, 
and proving certain technical properties for them. 
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2.1 General normed spaces 

Definition 1. I2~R Let (X, \\ ■ \\x) be a normed space. For xi,X2 £ X, the 
right and left semi inner products are defined by 

{xi,x 2 )± = \\xi\\ x lim - (|jxi + hx 2 \\x ~ \\xi\\x) ■ (1) 

h— >0± tl 

Remark 1. As every norm possesses left and right Gateaux-differentials, the 
limits in ([I]) exist and are finite. For more details see |27j . 

Remark 2. The right and left semi inner products (v)±> induce the norm 
|| ■ ||x in the usual way: (x,x)± = \\x\\ x . Conversely if the norm arises from 
an inner product (•,•), as when X is a Hilbert space, (x\,x 2 ) + = (xi,X2)~ = 
(xi,x 2 )- Moreover the right and left semi inner products satisfy the Cauchy- 
Schwarz inequalities: 

-IMI • IMI < ( x ,y)± < Ikll • IIj/II- 



The following elementary properties of semi inner products are consequences of 
the properties of norms. See |25} [26] for the proof. 

Proposition 1. For x,y,z&X and a > 0, 



1- (x, -y)± = -(x,y) T ; 

2. {x,ay)± = a{x,y)±; 

3. (x,y)- + (x,z)± < (x,y + z)± < (x,y) + + (x,z)±. 
Remark 3. In general, the semi inner product is not symmetric: 

(x,y)± + (y,x)±. 

Definition 2. 126^ Let (X, \\ ■ \\x) be a normed space and f : Y — > X be a function, 
where Y C X. The strong least upper bound logarithmic Lipschitz constants of f 
induced by the norm \\ ■ \\x, on Y , are defined by 

Mp x if]= -p (u -y (M) - /(t,))± , 



or equivalently 



Mf x w = SUP H i ( ll"- + W») -/W)lk _ ,) . (2) 

u^vev h-*o± h V \\u-v\\x 



If X = Y, we write M x instead of M x x . 

Proposition 2. Let (X, \\ ■ \\x) be a normed space. For any f , g: Y — > X and 

any Y C X: 

1. M+[f + g]< M+[f] + M+[g}; 
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2. Mp x [af] = aM± x [f] fora>0. 



Proof. 1. By the definition of My x , and the triangle inequality for norms, we 
have 



Mf x lf + g] = sup lim Ifll-- - + W;»)M-(/ + »)W)ll-V_ 1 

sup lim — f l|2( " ~ V) + 2k{if + g)(n) ~ (/ + 9 ^ v ^ x 
u -£ veY h^0+ 2ft V \\u - v\\ x 

< sup lin, J- /ll»- + f(/M-/(-))IU_ 1 V 

u ^ veY h^-o+ 2ft V |p-^||x / 

,. 1 ^ ||n-t; + 2ft(g(n)-g(^))|| x > 
sup lim — — - - 1 

u^v&h^Q+ 2ft V \\u - v\\x 

= M+ X [f] + M+ X [g] 

2. For a = 0, the equality is trivial, because both sides are equal to zero. For 
a > 0: 

n# ± r « r 1 /||«-« + fe(a/(u) -af(v)) \\x 
Myvbj = sup lim — n 1 

ujiveY h->0± h \ \\u-v\\x 

a (\\u-v + (ah){f{u) - f(v))\\ x 
sup hm — 



□ 



u ^ veY h~>o ± ah \ \\u — v\\x 

aM± [/]. 



Definition 3. I26\j Let (X, \\ ■ \\x) be a normed space and f : Y — > X 6e a function, 
where Y Q X . The least upper bound Lipschitz constant of f induced by the norm 
|| • || x, on Y , is defined by 

Ly,x[j\ — sup r . 

u^veY \\u — v\\x 

Note that L Y ,x[f] < oo if and only if f is Lipschitz on Y . 

Definition 4. I26\j Let (X, \\-\\x) be a normed space and f : Y — > X be a Lipschitz 
function. The least upper bound logarithmic Lipschitz constant of f induced by 
the norm || • ||x, on Y C X, is defined by 

M Y ,x[f] = lim \ (L Y ,x[I + hf] - 1) , 

n— >0+ ft 

or equivalently 

MrMfi = Mm sup I ( ^iMi* - l) (3) 
h->0+ n ^, G y ft \ ||«-U||X / 

If X = Y, we write Mj instead of Mx,x- 

Lemma 1. M+ x [/] < My jX [/]. 
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Proof. For any fixed u ^ v € Y, 

\\u-v + h(f(u)-f(v))\\ x< ^ \\u-v + h(f(u)-f(v))\\ x 



\\u-v\\x u^veY \\u-v\\x 

Now using this inequality, we have: 

1 ( \\u-v + h{f(u)-f(v))\\ x A 1 ( \\u-v + h{f{u)-f(v))\\x \ 
hm — [i [i 1 < urn sup — 7. [i II. 

mo+ ft \ \\u-v\\x ) h-+o+ u^v& h V If-^IIx / 

Since this inequality holds for any u ^ t> G V, taking sup we have: 

sup lim l /l|.-. + *(/(«.)-/W)k _ A < lim sup I + _ ^ 

„^„ e y h^0+ h \ \\u-v\\x J h-rf)+ u^veY h \ \\u-v\\ x , 

from which the conclusion follows using (|2|) and (J3j) - D 

2.2 Finite dimensional case 

The least upper bound (lub) logarithmic Lipschitz constant generalizes the usual 
logarithmic norm; for every matrix A we have Mx[^4] = //x-[A|. For ease of 
references, we review next the basic properties of logarithmic norms for finite 
dimensional operators. 

Definition 5. Let (X, || • \\x) be a finite dimensional normed vector space overM 
or C. The space C(X,X) of linear transformations A: X — > X is also a normed 
vector space with the induced operator norm 

\\A\\ X ->x = sup 

\\ x \\x=l 

The logarithmic norm fJ>x{ m ) induced by \\ ■ \\x is defined as the directional deriva- 
tive of the matrix norm, that is, 

fi X (A)= lim - + hA\\ x ^x -1), 
h->o+ h 

where I is the identity operator on X. 

Remark 4. Since sup(as + b) = asup(s) + b, whenever a > and 5 C M, it 

s&s ses 

follows that 

Hx(A) = lim sup — + — 1) . 

h ^ 0+ bllx=l h 

Theorem 1. For any matrix A, fJ,(A) = sup lim — (\\v + hAv\\ — 1). 

||«||=l h~^o+ h 

See the Appendix for the proof. 

Corollary 1. Let (X, ||-||x) be a finite dimensional normed space. For any linear 
operator C: X — > X, 

fi X (C) = M+[C] = M X [C]. 
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Proof. The proof is immediate from the definition of Mx, Mi, and Theorem 

ED □ 



When X = M n or C n , we identify operators and their matrix representations on 
the standard basis, and we call the logarithmic norm the matrix measure. In 
Table Q3 the algebraic expression of the logarithmic norms induced by the L p 
norm for p = 1,2, and oo are shown for matrices. For proofs, see for instance 



Table 1: STANDARD MATRIX MEASURES FOR A REAL n X n MATRIX, A = [dij]. 



vector norm, • 


induced matrix measure, n(A) 


n 

\\ x h = ^2 1 37 *! 

8=1 


^i(A) = max 
J \ 




1 




H2{A) = max 

Agspec A 




) 


OC 00 — m 3j!X! 3C 2 
l<j<n 


fJ-oo(A) = max 


{ &3 J 


) 



For ease of reference, we summarize the main notations and definitions in Table 

El 

Table 2: Basic Concepts 



Notation 


Definition 


Equivalent Definition 


Equivalent Definition 


ciM 


lim - + hA\\ x ^ x - 1) 


lim sup — (\\x + hAx \\ x — 1) 


sup lim — ( \\x + ftj4x|| x ~ 1) 

11^11^=1^0+ h 


Ly,x\J] 


sup . . . 






-W.xlf] 


fa Jfep + i/l-l) 

ft— >0+ ft 


inn sup + 




(tt,lf)+ 


||ar||x Bm i(||a + h»||x-NW 

ft— S>0+ ft 








"„n ( U - "l /(«)- /("))+ 




su P HmI(ll"- W+ | f^r / ^H--l) 


SUP r, 


u ^„ e y/l->0+ ft V II" - v \\x ) 



3 Weighted L p norms 

Suppose Q, a bounded domain in M m with smooth boundary dQ and outward 
normal n, and a subset V C M n have been fixed. We denote 



G 



where (Clj is the set of twice continuously differentiable functions Cl — > M. 
In addition, we denote X = Cr™ (il) , where Cr™ (fj) is the set of all continuous 
functions Q — > R n . 



Note that for each i, for 1 < p < oo, \\vi\\ p = I / |fi(a;)| p duo I and for p = oo, 



J i \\p 



sup and both are finite because Vi is a continuous function on f2 



and is a compact subset of M m . 

For any 1 < p < oo, and any nonsingular, diagonal matrix Q = diag (qi, ■ ■ ■ , q n ), 
we introduce a Q-weighted norm on X as follows: 

Q ihiWp, ■ ■ ■ , IKI| P ) T 



*P,Q '" 



Since 



Vi 



<p,Q 



sup |%||M|p 



V 

1 < p < OO 
p = oo 



(4) 



without loss of generality we will assume qi > for each i. 

With a slight abuse of notation, we use the same symbol for a norm in M. n : 



\x\ 



Lemma 2. For any v € X, \\v\ 



\\Qx\\ p . 

where 



p,Q' 



\\Qv(u)\\* dui 

SUp ||Qf(w)||oo 



1 < p < OO 
p = oo 



(5) 



Note that \\Qv(uo)\\p = \qiV i(uj)\ p and ||Qv(w)||oo = SU P lowO^)! ■ 



Proof. Let Q = diag(gi, • • • , q n ), q^ > 0. For 1 < p < oo (the proof is analogous 
when p = oo), by the definitions of ||-|| p q and || • || ^ 



p,Q 



\\Qv(uo)\\ p duo 
\\{qivi{uj),- ■ ■ , q n v n {uo)) T \\ p duo 
\qiVi(oj)\ p H h \q n v n (uo)\ p duo 



(qi\\vi\\ P ,--- ,qn\\v n \\p) T 



WQiWnWp,- ■ ■ , IKIIp) T ||p 



□ 
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Note that this equality between weighted p norms of functions and of vectors 
depends on our having taken the matrix Q to be diagonal. This is the key place 
where the assumption that Q is diagonal is being used. 



4 Main Result 



In this section, we study the reaction-diffusion PDE: 



du 

— (co,t) = F( U (Lo,t)) + DAu(io,t) (6) 



subject to the Neumann boundary condition: 

— (£,t) = V£ G dn, V* G [0,oo). (7) 
Assumption 1. In © — ((7J) we assume: 

• -F: V — >■ M n is a (globally) Lipschitz and twice continuously differ entiable 
vector field with components Fi : 

F(x) = (F 1 (x),--- ,F n (x)) T 

for some functions Fi : V — > R, where V is a convex subset ofW 1 . 

• D = diag(di, • • • , d n ), with d{ > 0, is called the diffusion matrix. 

• Q, is a bounded domain in lR m with smooth boundary dVl and outward normal 
n. 

Definition 6. By a solution of the PDE 

du 

— (cj, t) = F(u(u, t)) + DAu(lu, t) 

_(&*) = o y^edn, vte [0,00), 

on 

on an interval [0,T), where < T < oo, we mean a function u = (u\, ■ ■ ■ , u n ) T , 
with u: 0, x [0, T) — > V, such that: 

1. for each wgfi, u(u), •) is continuously differentiate; 

2. for each t G [0, T), u(-,t) is in Y; and 

3. for each and each t G [0, T), u satisfies the above PDE. 

Theorems on existence and uniqueness for PDE's such as ([6]) — (|7|) can be found 
in standard references, e.g. |29^ 130] , One must impose appropriate conditions 
on the vector field, on the boundary of V, to insure invariance of V. Convexity 
of V insures that the Laplacian also preserves V. Since we are interested here 
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in estimates relating pairs of solutions, we will not deal with existence and well- 
posedness. Our results will refer to solutions already assumed to exist. 

Pick any < T < oo and suppose that u is a solution of (0) — ([7]) defined on 
£1 x [0, T). Define u: [0,T) — > Y by u(t)(oj) = u(oj,t). Also define the function 
F : Y — > X as follows: for any u € Y, 

F(u)(oj) = F(u(oj)) for each oj € Cl. 

Let A Pt Q : Y — > X denote an n x n diagonal matrix of operators on Y with the 
operators (fjA on the diagonal. 

Lemma 3. Suppose that u solves the PDE ([6]) — ([7J), on an interval [0,T) ; for 
some T 6 (0, oo], and let 

, du . 

v{oj,t) := -Q^iu^) 

for each t > and oj € Cl. We introduce v: [0,T) — > X 6y v(t)(oj) = v(oj,t). 
Then, v(t) is the derivative of u(t) in the space (X, ||-|| p q), that is: 



lim 



[u{t + h) -u(t)\ -v(t) 



0. 



P,Q 



for all t € [0, T) . Moreover, 

v(t) = F(u(t))+A p , Q (u(t)). 



(8) 



Proof. Fix t G [0, T) and % G {1, • • • , n}. Using the definition of we have: 



lim 

/i->0 



- t + h) - Ui(uj, t)} - Vi(uj, t) 



0, 



for any oj € 0. Hence for any e > 0, there exists /i w > such that for any 
<h<hu, 



^ [iti(w,i + h) - Ui(oj,t)] - Vi(uj,t) 



e 

< 2- 



Now since u% is a continuous function of oj, there exists a ball B w centered at oj 
such that for any < h < h w , 



Ui(u),t + h) - tti - Vi(cu,t) 



< e 



for all a) € -B w . Since {-B^ : oj € fi} is an open cover of Cl and H is a compact 
subset of M m , finitely many of these balls, namely B Wl , • • • , B UJk , cover 0. Now 
let foo = m i n {h wi , • • • , /i Wfe ). Then, for any < h < ho and any oj £ Q, we have 



- [ui(oj, t + h) - Ui(oj, t)] - Vi(oj, t) 
h 



< €. 



Raising to the p-th power and taking the integral over O of the above inequality, 
we get 



[ui(u),t + h) - Ui(oj,t)] - Vi(oj,t) 



doj < \tt\e p , 



which by the definition of ||-|Lg, it implies that for any < h < ho, 



_[ u ^ t + h)-u(-,t)]-v(-,t) 



< ce, 



where c = (|f2| Ya=i 1i) p ■ Since e > was arbitrary, we have proved that 



lim 



[u(t + h) -u(t)] -v{t) 



For a fixed t G [0, T) and any w G fi: 

du 

v(t)(uj) = v(t,u) = -Qj:(u,t) = F(u(u,t)) +DAu(uj,t) 
= F(£(i))(u;)+^, Q (&(i))(a;), 

and therefore Equation (jSJ) holds. 



□ 



In this section we show that (jfij) — © is contracting (meaning that solutions 
converge exponentially to each other, as t — > +oo) if M Pi q[F] < 0, where, as 
defined before, 



y + h(F{x)-F(y))\\ PiQ \ 
M P} q[F\ = hm sup - I — - 1 I . 



l / If 



Now we state the main result of this section. 

Theorem 2. Consider the PDE ([6]) — (J7J) and suppose Assumption{l\holds. Let 
c = M p ^q[F] for some 1 < p < oo, and some positive diagonal matrix Q. Then 
for every two solutions u, v of the PDE © — ([7]) and all t G [0, T): 



\u(t)-v(t)\\ o <e ct \\u(0)-v(0)\ 



p,Q ■ 



Remark 5. In terms of the PDE (J6J) — , this last estimate can be equivalently 
written as: 

\W(-,t)-v(-,t)\\ o <e ct \\u(.,0)-v(-,0)\\ 



Before proving the theorem, we prove a few technical lemmas. 

Definition 7. The upper left and right Dini derivatives for any continuous func- 
tion, fy: [0, oo) — > R, are defined by 

(D^) (t) = lim sup - (¥(t + h) - . 
h^0 ± h 



Note that D + ^> and/ or D ^> might be infinite. 



10 



Lemma 4. Let (X, \\ ■ \\x) = (Cm.™ , ||"|| P) qV Let G: Y — >• X be a (globally) 

Lipschitz function, where Y C X. Let u,v: [0, oo) — > Y be two solutions of 
du(t) 



dt 



G(u(t)). Then for all t € [0, oo) 



^ (« - " W X = [77 7777772 u ~ w )(*) \\X- (9) 

When u(t) = v(t), we understand the right hand side through the limit in (|10p. 
Proof. By the definition of right semi-inner product, the right hand side of ([9]) is: 

lim i (||(u - v)(t) + /i(G(u(*)) - G(v(t)))\\ x -\\(u- v)(t)\\ x ) , (10) 
hence we just need to show that 

D + ||(n- V )(t)|| x = lim ~ (||(« - v)(t) + h(G(u(t)) - G(v(t)))\\x - ||(u - «)(f)||*) . 
Now using the definition of Dini derivative, we have: 

D+\\(u-v)(t)\\ x = limsupi (\\{u-v)(t + h)\\ x -\\(u-v)(t)\\ x ) 

= limsup - (||(« - v)(t) + h(u - v){t) + o(h)\\ x ~ \\(u- v)(t)\\ x ) 

= limsup -(\\(u-v)(t) + h( y u-v)(t)\\x - \\(u - v)(t)\\ x ) 

= lim \ {\\{u - v)(t) + h(u - v){t)\\x -\\(u- v)(t)\\ x ) 

= lim \ (\\(u - v)(t) + h{G{u{t)) - G{v{t)))\\ x - ||(u - «)(t)||x) , 

where u = — . Note that the fourth equality holds because of Remark [TJ □ 
dt 

Corollary 2. Under the assumptions of Lemma® for any t £ [0, oo) we have: 

D+\\u{t)-v{t)\\ x < M+ x [G]\\u(t)-v(t)\\ x . (11) 

Proof. By the definition of the strong least upper bound logarithmic Lipschitz 
const ct lit 

((u-v)(t),G(u(t))-G(v(t)))+ < M+ , n 
\\(u-v)(t)\\ x - M ^ [GJ - 

Now apply Lemma 0] to the above inequality. □ 
Corollary 3. Under the assumptions of Lemma® for any t E [0, oo) we have: 

\\u{t) - v(t)\\ x < e M ^ [G]i |H0) - v{0)\\ x . 

Proof. Apply Gronwall's inequality, pH], to (fTTI) . □ 
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Remark 6. Note that for any bounded linear operator C: X — > X, and any 

du 

solution u: [0, T) — > X of — = Cu, the above result says that 

at 



D + \\u(t) 



x 



(u(t),Cu(t)). 



\u(t)\\ x <M+[C]\\u(t)\\x, 



for all t € [0,T). 

Lemma 5. Let A Pt Q, as defined above, denote an n x n diagonal matrix of oper- 
ators on Y with the operators d{A on the diagonal. Then My X [A Pi q] < 0. 

Proof. To prove the lemma, we consider the following three cases: 

Case 1. 1 < p < oo. By the definition of My X L4 Pi q], it's enough to show that 
for any u € Y with \\u\\ q / 0, and any e > 0, there exists h e > 0, depending on 
e, such that for < h < h e , 



( 



1 ( \\u + hDAu\ 



v 



< e. 



(As A Pt QU = DAu, we write DAu instead of Ap^it.) 
Therefore we'll show that for h small enough 

Y.tfWui + hdiAuiW' < (l + eh)P^2qf\\ Ui \ 



(12) 



Let's define k: [0, 1] — > R as follows: 



fc(/i) = ^ gf + /i^Au, ||5 - (1 + ehf Q 



• Hp- 



Observe that k is continuously differentiable: 

k'(h) = J"I>f / ^i^ + h^Au^ dco-peil + ehf^Y^oi^l 

= Z^Qi p\ui(LL>) + hdiAui(uj)\ p ~ 2 (ui(co) + hdiAui(uj)) diAui(uj) du: 
i J n 

~ pe{l + ehf-^1 P Mi\\ P P - 

i 

Note that in general \g\ p is differentiable for p > 1 and its derivative is p\g\ p ~ 2 gg' ■ 
Now by Green's identity, the Neumann boundary condition, and by the assump- 
tion that y^gf IKillp 7^ 0, it follows integrating by parts that: 



fc'(0) = pY^ ' q p / \ui(u))\ p 2 Ui(u)diAui(u) du) - pe^ q p \\ui 

I I 

= -Vip - 1) E gf d i J \ui(u})\ p ~ 2 Vui(uj) 2 du - pe^Q 



p \\v\\ p 



< 0. 
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Since k'(0) < and k' is continuous and k{0) = 0, k(h) < for h small enough 
and therefore Inequality (|12|) holds. 

Note that by the definition of Y, any u G Y satisfies the Neumann boundary 
condition. 



Case 2. p = 1. Let 



q(p) := lim — 



V 



Erf 



Since is a continuous function at p = 1, and since in Case 1, we showed that 
g(p) < for any p > 1, we conclude that g(l) < 0. 

Case 3. p = oo. Before proving this case we need the following lemma, which 
is an easy exercise in real analysis. (For completeness, we include a proof in an 
appendix.) 

Lemma 6. Let O C R m be a Lebesgue measurable set with finite measure |0| and 

i 

1 



let f be a bounded, continuous function on R. Then F(p) :- 
an increasing function of p and its limit as p — > oo is ||/||oo- 
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l/P 



For a fixed po > 1, pick u G Y with ||u|| Po q ^ 0. By the definition of the 
norm, |H| P0 ,q ^ implies that for some iq G {!,•■■ , n}, \\ui \\ PQ ^ 0. Let 



<p(p) ■-- 



1 



1 II "10 

|fi|* 



L. By Lemma [BJ (p is an increasing function of p, hence for any 



p > po, \\u,i ||p > \\ui ||p > 0. Now fix i G {1, • • • , n}, p > po, and e > 0. Define 
k as follows: 



k{h) 



\ui + hdiAui\\% - (1 + eh) p \\ui \\% if \\u io \\ p > \\ui\\ p 
\\ui + hdi^UiWl - {I + eh) p \\ui\\l if IKo Hp ^ IKIIp 



In both cases k(0) < and A/(0) < (the proof is similar to the proof of fc'(0) < 
in Case 1, since both ||tij || p > and ||uj || p > 0). Therefore, for some small h, 
k{h) < which implies that: 



\uj + hd;Au 



lim — 

h^0+ h 

Now by Lemma[6l since -||uj+/i<iiA?/j||p 

|fi|F 

1 1 «i I |oo as p — > oo, we can conclude that 



i up 



1 < 0. 



lim 

h->0+ h 



1 / \\ u i + hd~Au~\ 



lui+hdiAuiWoo, and 



1 < 0. 



mi* 



In other words, for a fixed e > 0, there exists hi > such that for any < h < hi, 
\\m + hdiAuiWoo < (1 + e/OIKHoo f° r an y i€{l,...,n}. 
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Let ho = mm hi. Then for any < h < ho, 

i 

max qi\\ui+hdiAui\\oo =: qj\\uj+hdjAuj\\oo < <&'(l+ e ^)||%'||oo < (1+eh) maxgj||uj 
which implies 

1 /maxgiljuj + /idjAuiHoo \ 

lim - — — 1 < 0. 

h^o+ h I max 1 1 Mj| loo J 

□ 

Lemma 7. For any function F , any 1 < p < oo, and any positive diagonal 
matrix Q, 

M+ X [F] < M PjQ [F], 

where M Pt Q is the lub logarithmic Lipschitz constant induced by the norm \\ ■ \\ p ,q 
defined on W 1 : ||a;||p,Q = ||Qx|| p . 

Proof. By the definition of c := M p „q[F], we have 

1 f \\x — y + h(F(x) — F(y))\\ q \ 
nm — sup - 1 = c. 

h-*o+ h xftev \ \\ x -y\\p,Q J 

Fix an arbitrary e > 0. Then there exists ho > such that for all < h < ho, 

1 f\\x — y + h(F(x) — F(y))\\ q \ 

- sup n n — - 1 < c + e. 

hx^yev\ \\ x -y\\p,Q J 

Therefore, for any x ^ y, and < h < ho 

\\x-y + h(F(x)-F(y))\\^ Q 

< (c + e)h + 1. (13) 



\ x ~ y\\p,Q 



For fixed u ^ v £ Y, let Cl\ = {oo € Q : u(uS) ^ v(jjj)}. Fix u 6 (Ji, and let 
rr = u(w) and y = i>(u;). We give a proof for the case p < oo; the case p = oo is 
analogous. Using equation (fT3|) . we have: 



<(c + e)/t + l. (14) 



(£g?M«)-t*(w)[*J 

Multiplying both sides by the denominator and raising to the power p, we have: 
^ q\ \ui(u) - Vi(oj) + h (Fi(u(oj)) - Fi(v(u;)))\ p < (( c +e)h+lf ^ gf Ku,)-^H|*\ 

(15) 
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Since F(u)(ui) = F(u(uj)), Equation (|15[) can be written as: 

q- - Vi{oj) + h (Fi(u)(u) - Fi(v)(oj)^ | P < ((c+e)/i+l) p ^ gf 

i i 

(16) 

Now by taking the integral over Q, using Lemma [51 we get: 



u-v + h( F(u) - F(v) < ((c + e)h + 1) ||u - v\L , 

(Note that for oj £ f2i, 

((c + e)h + If ^ qV\ Ul (u, t) - Vi (u>, t) \ p = 



which we can add to the right hand side of (|T6|) . and also 

^gf|«i(w) - + /itFiMa;)) - ^(^H))| p = 



which we can add to the left hand side of (|T6|) , and hence we can indeed take the 
integral over all 0.) 

Hence, 



lim — 

h-+o+ h 



u-v + h (F(u) - F(v) 



p,Q 



1 < c + e. 



it — v 



Now by letting e — > and taking sup over u / » £ Y, we get < c. □ 

Proof of Theorem [2]. For any 1 < p < oo, by subadditivity of semi inner 
product, Lemma El and Lemma El 

M+ x [F + A p>Q ]<M+ x [F]<c. 

Now using Corollary El 

\\Ht)-v(t)\\ P ,Q < e ct \\u(0)-H0)\\ P , Q , 

for all i € [0, oo). 

□ 

Theorem 3. Consider the reaction- diffusion system (|6j) — ([7]) and suppose As- 
sumption^ holds. In addition suppose for some 1 < p < oo, c € R, and a positive 
diagonal matrix Q, /^ p ,q( Jf(x)) < c /or aZZ x £ V , where ^ p ,q is i/ie logarithmic 
norm induced by ||-|Lq- Then, for any two solutions u,v of ^ — ([7]), we have 



W;t)-v(;t)\\ PtQ < e Ct \\u(;0)-v(;0)\\^ Q . 
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Remark 7. In general the result of Theorem [3] holds also for time varying sys- 
tems: 

du 

— (u,t) = F(u(u,t),t) + DAu(u,t) (17) 
at 

OF 

when we assume H p ,q( Jf{%, t)) < c, where Jp(x,t) is the Jacobian -^—(x,t), for 
all x € V and t > 0. 

We omit the details of this easy generalization. 

To prove Theorem El we use the following proposition, from [32] . 

Proposition 3. Let (X, \\ ■ \\x) be a normed space and Y is a connected subset 
of X. Then for any (globally) Lipschitz and continuously differ entiable function 
f:Y ->R n , 

supn x (J f (x)) < M Y ,x[f}- 
Moreover ifY is convex, then 

sup fix {J f (x)) = M Y ,x[f )■ 
Proof of Theorem [3l The proof is immediate from Theorem [2] and Proposition 

El 

Corollary 4. Consider the reaction- diffusion system ([6]) — ([7]) and suppose As- 
sumption [I] holds. In addition suppose for some 1 < p < oo, and a positive 
diagonal matrix Q, fjL Py Q(Jp(x)) < for all x GV. Then ([6]) — ([7]) is contracting 
in Y, meaning that solutions converge (exponentially) to each other, as t — > +oo. 

5 Example 

We provide an example of a biochemical model which can be shown to be con- 
tractive by applying Corollary H] when using a weighted L 1 norm, but which is 
not contractive using any weighted I? norm, so that previous results can not be 
applied. Even more interestingly, this system is not contractive in any L p norm, 
p > 1. The example is of great interest in molecular systems biology |20j . and 
contractivity in a weighted L 1 norm was shown for ODE systems in [21] . but the 
PDE case was open. The variant with more enzymes discussed in [21] can also 
be extended to the PDE case in an analogous fashion. 

Example 1. A typical biochemical reaction is one in which an enzyme X (whose 
concentration is quantified by the non-negative variable x = x(t)) binds to a 
substrate S (whose concentration is quantified by s = s(t) > 0), to produce a 
complex Y (whose concentration is quantified by y = y(t) > 0), and the enzyme 
is subject to degradation and dilution (at rate 5x, where S > 0) and production 
according to an external signal z, which we assume constant (a similar result 
would apply if z is time dependent, see Remark[7]). An entirely analogous system 
can be used to model a transcription factor binding to a promoter, as well as many 
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other biological process of interest. The complete system of chemical reactions is 
given by: 

oAxAo, X + S ^Y. 

ki 

We let the domain Q represent the part of the cytoplasm where these chemicals are 
free to diffuse. Taking equal diffusion constants for S and Y (which is reasonable 
since typically S and Y have approximately the same size), a natural model is 
given by a reaction diffusion system 

xt = z — 5x + k±y — k2sx + d\Ax 
Vt = -hy + k 2 sx + d 2 Ay 
st = kiy — k 2 sx + ^As. 

If we assume that initially S and Y are uniformly distributed, it follows that 
d 

— {y{uj, t) + s(u), t)) = 0, so y(u), t)+s(oj, t) = y{oj, 0)+s(w, 0) = Sy is a constant. 
Thus we can study the following reduced system: 

xt = z — 5x + k\y — k 2 {Sy — y)x + d\Ax 
Vt = ~hy + k 2 (S Y - y)x + d 2 Ay. 

Note that (x(i),y(t)) £ V = [0, oo) x [0, Sy] for alU > (V is convex), and S Y , 
ki, k 2 , 5, di, and d 2 are arbitrary positive constants. 

Let J be the Jacobian of F = (z — 5x + k±y — k 2 (Sy — y)x, —k\y + k 2 (Sy — y)x) T : 



J 



-8 — k 2 {Sy — y) k\ + k 2 x 
k 2 {Sy-y) -{ki + k 2 x) 



In [2l] . it has been shown that sup /x^q (J(x, y)) < for Q = diag (l, 1 + - — ( 

x,y£V ' \ k 2 Sy 

where < £ < — — . Therefore by Corollary [H the system is contracting. Note 
k 2 Sy 

that a weighted norm L 1 is necessary, since with Q = I we obtain fj,i = 0. 

We'll show that for any p > 1 and any diagonal Q, it is not true that ^ Pj q( J(x, y)) < 
for all (x, y) G V. 

Without loss of generality we assume Q = diag(l, q). Then 



QJQ' 1 



where a = k 2 (Sy — y) E [0, k 2 Sy] and b = k\ + k 2 x € [k±, oo). 

We first consider the case p ^ oo. We'll show that there exists (xo,yo) G C 
such that for any small h > 0, ||7 + hQJ(xQ, yo)Q~ 1 |L > 1. This will imply 
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^p,q{.J{ x OiVq)) — 0- Computing explicitly, we have: 



\I + hQJQ~ l \ 



sup 

(6,6)^(0,0) 



fi - h(S + a)6 + h 



K2 



(i?ii p + ie 2 | p )^ 



> 



l-h(5 + a) + h— 



+ \haq + A - hb\\ p 



(1 + \X\p)p 



where we take a point of the form (£1,^2) = (IjA), for a A > which will be 
determined later. To show 



l-h(5 + a) + h 



bX 



+ I haq + A — hbX\ 



> 1, 



(1 + \X\p)p 

we'll equivalently show that for any small enough h > 0: 



l-h(6 + a) + h— 



+ \haq + X - hbX\ p - 1 - \X\ P > 0. (1 



Note that the lim + of the left hand side of the above inequality is /'(0) where 

f(h) = \l + h(j-(5 + a))\P + \X + h(aq-bX)\P. 

Therefore it suffices to show that /'(0) > for some value (2:0,2/0) ^ ^ (because 
/'(0) > implies that there exists ho > such that for < h < ho, (fTB"|) holds). 
Since p > 1, by assumption, / is differentiable and 



l + h[—-(S + a) 
q 



p-2 



+ p(ag — 6A) I A + h(aq - bX)\ p ~ 2 (A + h(aq - bX)) 
Hence, since A > 

'bX 



l + h(j-(5 + a] 



f(0) 



PI (<5 + a) + p(aq - bX)X p ~ 1 

q 



Choosing A small enough such that 1 — X p 1 q > and choosing x, or equivalently 
6, large enough, we can make f'(0) > 0. 

For p = 00, using Table [H fJ-piQJQ^ 1 ) = max / — 5 — a H — , — b + agl. For large 

enough x, — 5 — a H — > (and — 6 + ag < 0) and hence UooiQJQ 1 ) > 0. 
9 
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6 Diffusive interconnection of ODEs 



In this section, we derive a result analogous to that for PDE's for a network of 
identical ODE models which are diffusively interconnected. We study systems of 
ODE's as follows: 

u(t)=F(u(t))-(L<g>D)u(t). (19) 



Assumption 2. In (1 1 9 [> . we assume: 

• For a fixed convex subset ofW 1 , say V , F: V N — > W lN is a function of the 
form: 

F(u) = (F( Ul f,--. ,F(u N ) T ) T , 

where u = (uf , ■ ■ ■ ,uJj) T , with U{ € V for each i, and F: V — > W 1 is a 
(globally) Lipschitz function. 

• For any u € V N we define \\u\\ p q as follows: 

\\ U \\ P ,Q = (IIQ^illpr- - , \\Qun\\ p ) T 

where Q = diag (qi, - ■ ■ ,q n ) is a positive diagonal matrix and 1 < p < oo. 
With a slight abuse of notation, we use the same symbol for a norm in W 1 

ll^llpiQ := 1 1 1 1 - 



u: [0, oo) — > V is a continuously differentiate function. 

• D = diag(di, • • • ,d n ) with d{ > 0, which we call the diffusion matrix. 

• L € M, NxN is a symmetric matrix and LI = 0, where 1 = (1, • • • , 1) T . We 
think of L as the Laplacian of a graph that describes the interconnections 
among component subsystems. 

Theorem 4. Consider the system (|19|) and suppose Assumption holds. Let 
c = M P) q[F], where M Pt Q is the lub logarithmic Lipschitz constant induced by the 
norm \\ ■ \\ Pi q on M n defined by ||x|| Pi q := ||Qx|| p . Then for any two solutions u,v 
of (fT9|) . we have 

\Wt)-v(t)\\ P , Q <e ct \\u(0)-v(0)\\ P , Q - 

This theorem is proved by following the same steps as in the PDE case and using 
Lipschitz norms and properties of discrete Laplacians on finite graphs. For ODEs, 
we can make some of the steps more explicit, and for purposes of exposition, we 
do so next. We start with several technical lemmas. 

The following elementary property of logarithmic norms is well-known. To see 
more properties of logarithmic norm see |28j . 

Lemma 8. Let A be the largest real part of an eigenvalue of A. Then, [i p ^q{A) > 
A. 
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Proposition 4. For any 1 < p < oo, M^{—L®D) = 0, where is the strong 
least upper bound logarithmic Lipschitz constant induced by the LP norm. 

Proof. Let C = —L (g) D = (Cij). Note that since LI = 0, by the definition 
of Kronecker product, CI = 0. In addition because L is symmetric and D is 
diagonal, C is also symmetric and therefore CI = 1C = 0. Also the off diagonal 
entries of C, like —L, are positive because L is a Laplacian matrix. By Corollary 
[H it suffices to show that n p (C) = for any p. We first show that fJ> p (C) = for 
p = 1, oo. For p = 1, 

Hi{C) = max N + = maxO = 0. 

i — ' i 

i/j,i=l,...,n]\f 

Similarly for p = oo, 

Moo(£) = max / + | Ail) = niaxO = 0. 

i * — ' j 

Now suppose p / l,oo. By Lemma [HI fJ> p (C) > where A is an eigenvalue 
of C. Because CI = 0, A = is an eigenvalue of C; therefore fJ, p (C) > 0. To 
show that [J> p (C) < 0, by Remark El it suffices to show that -D + ||ti|| p < where 
u is the solution of u = Cu. By the definition of Dini derivative, it suffices to 
show that ||ti(i)|| p is a non-increasing function of t. Let $(u(t)) := ||u(t)||p, where 
u = (uf , ■ ■ ■ , u^) T with Ui = (uj, • ■ ■ , uf) T € V n . Here we abuse the notation 

and assume that u = (u±, ■ ■ ■ ,u n N) T . We'll show that ~^( u (^)) — 0- 

First we'll prove the following inequality: 

Lemma 9. For any real a and f3 and 1 < p: 

(| a |P-2 + \p\P-2) a p < \ a \P + \p\P. 

Proof. For a/3 < 0, the inequality is trivial. Suppose a/3 > 0, and w.l.o.g |/3| > |aj 
/3 

and let A = — . Then it suffices to prove that for A > 1, 
a 

(1 + A P " 2 )A< A p + 1. 

Let /(A) = XP' 1 + A - X p - 1. We want to show that /(A) < for A > 1. Since 
/(l) = /'(l) = and /"(A) < for A > 1, indeed /(A) < 0. □ 

As we explained above, C is symmetric and CI = 0. Using this information and 
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the above inequality: 



d<f>, ... ^ d<S> dui 



p(|«l| p-2 ltl,--- , \UnN\ P ~ 2 UnN)£(ui,--- ,U nN ) T 

\ui\ p ~ 2 Ui£ijUj 

i,3 



i i<j 

= p ^2 \ u i \ p \ Ai + X] A? 



<9$ d 



since ^ — = \ui\ p = p\ui\ p = p\ui\ p 2 Ui. Note that \x\ p is differentiate 

OUi OUi \Ui\ 

for p > 1. □ 

Lemma 10. Lei // p and /U P! <g denote the logarithmic norms induced by \\ ■ \\ p and 
II ' \\p,Q respectively. Then 

V p ,q(-L <g> D) = fip(-L ® D). 
Proof. Recall the following properties of Kronecker product: 

• (A ® B)(C ® D) = (AC) ® (BD); 

• If A and B are invertible, then (A ® i?)^ 1 = A" 1 ® B _1 . 
Hence: 

H p ,q{-L®D) = fi p [(I <g>Q)(-L<g) D)(I 
= v P (-L®QDQ- 1 ) 
= fi p (-L(g)D). 

The last equality holds because both Q and -D are diagonal, and so are commu- 
tative. Therefore QDQ~ l = DQQ~ l = D. □ 

Proposition 5. Let M^q denote the strong least upper bound logarithmic Lips- 



chitz constant induced by the norm \\ ■ \\ Pt Q on R . Then, 
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Proof. By Proposition [H Corollary [I] and Lemma \W\ 

M p,q[- l ® d ] = Vp,q(- l ® d ) = Vp{-L®D) = M+[-L®D] = 0. 



□ 



Lemma 11. Let M^q denote the strong lub logarithmic Lipschitz 



constant in- 



duced by the norm 



on 



and M P: q is the lub logarithmic Lipschitz 



constant induced by the norm \\ • \\ Pj q on M n . Then, 

M+ Q [F]<M P>Q [F}. 

Proof. The proof is exactly the same as the proof of Proposition [7J □ 
Proof of theorem [4]. By subadditivity of M~^ n , Proposition [2l Proposition [5l 

PiW 

and Lemma QTJ 

M+ Q [F-L®D] < M+ Q [F]+M+ Q [-L®D] < M PtQ [F] = c. 
Now using Corollary El 

\Ht)-v(t)\\ p>Q <e ct \\u(0)-v(0)\\p,Q- 



Lemma 12. Assume F is a linear operator. Then 

H P]Q (F-L® D) <n q , Q (F) if p = q. 



□ 



(20) 



Proof. The proof is immediate by subadditivity of logarithmic norm, Proposition 
[lU and Corollary [U □ 



Remark 8. Note that (I20j) doesn't need to hold if p 7^ q. Consider the following 
system: 

±1 = Ax\ + D(x2 — xi) 
±2 = Ax 2 + D(xi - x 2 ), 



where x; € R 2 , A 



-2 1 ' 
1 -2 

and F = diag(A,A). We'l 
H hQ (F-L®D) > 0. 

By Table CO 



^ Q {F-L®D) 



and D = diag(<ii, cfo)- In this example L 
show that for Q = diag(3, 1), ^2,q{A) < while 



1 -1 
-1 1 



-2 - d 1 
1 

<h 



/'I 

1 > 0. 





2 - d 
1 
■i 

di 




^2 


"-2 

1 


3 ' 
-2 


< 0. 






- 3 










1 




dl 







2-d 2 







d 2 









-2 - dj 


1 




<h 




1 


-2-d 2 


3 




</i 







-2 - 


-d> 







d 2 







-2 


-di 


3 




d> 




1 

3 


-2-d 2 
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Theorem 5. Consider the reaction- diffusion ODE (|19p and suppose Assumption 
l^holds. In addition assume that F is continuously differentiable and [i Pj q{Jf{x)) < 
c for all x £ V. Then for any two solutions u, v of (fT9j) we have 

Ht) - v(t)\\ p , Q <e ct \\u(0)-v(0)\\ p , Q . 
Proof. The proof is immediate by Theorem 0] and Proposition [3j □ 



7 Synchronization 

In this section we will show that for any 1 < p < oo, and N = 2, and 3 nodes 
which are interconnected according to a connected, undirected graph, if c = 
sup h p ,q(Jf(u) — A-D), where V is a convex subset of W 1 and A is the smallest 

u€V 

positive eigenvalue of —L, then every solution u = (u±, ■ ■ ■ ,un) of (fT9l) : 

u(t) = F(u(t)) - {L®D)u{t) 
has the following property: 

W(t) < e ct W(0), 
where W(t) = \\w(t)\\ p and w is a row vector defined by 



w := \\\ u l ~ U 2\\p,Q ' • • • ' H u l ~ U ^Hp,Q' ll U 2 - u 3\\p,Q ; • • • > \\ u 2 ~ u N\\ Pi Q, ■ ■ ■ , \\UN-1 ~ UN\ 

To show this, we first state the following lemma from [25]: 
Lemma 13. For any p € (l,oo), (u,v)+ = IM|p _p ^™ =1 \ui\ p ~ 2 UiVi. 

For N = 2 nodes, there is just one possible graph: The complete graph with graph 
Laplacian matrix L = ~ which results in the following ODE system: 

x = F{x) + D(y — x) 
y = F{y) + D{x-y). 

Note that the smallest and only positive eigenvalue of —L is A = 2. For a 
fixed solution (x,y) of this ODE, let w(t) = \\x — y\\ p Q, W(t) = \\w(t)\\ p , and 
D[x) := Dx. Then by the definition of M p q, an d Lemma [TBI we have, 

= pYh=i h( x i ~ yi)\ p ~ 2 Qi( x i - yi)Qi{xi - m) 

= pYa=i \n( x i - yi)\ p ~ 2 Qi( x i - ViMi (Fi(x) - Fi(y) - 2 A fat - Vi)) 

< P \\Q(x-y)\\ p p M+ Q [F-2D] 
= pWP(t)M+ Q [F-2D) 

< P WP{t) sup n P]Q (J F (x,y)-2D). 

(x,y)£V 

The last inequality results by Proposition El 

sup » p ,q{Jf(x, y) - 2D) = M PjQ [F - 2D] > M+ Q [F - 2D]. 

(x,y)&V 



P,' 
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Therefore W(t) < e p p-^ jF - 2D)t W(0), i.e., in this case, 
\\x{t) - y(t)\\ p , Q < e ct \\x{Q) - y{Q)\\ 



which 



2W' 

where c = sup Hp,q{Jf{x,v) - 2D). 
(x,y)eV 

For N = 3, there are two possible graphs: 

First, the complete graph with graph Laplacian matrix L = 

leads to the following ODE system: 

x = F(x) +D(y - 2x + z) 
y = F{y) + D(x -2y + z) 
i = F{z) + D(x + y -2z). 

Note that the smallest positive eigenvalue of — L is A = 3. For a fixed solution 
(x, y, z) of this ODE, define w and W as follows: 

w (t) = {\\x - y\\ PtQ , \\y - z\\ Pj q, \\x - z\\ Pj q) , 

p . Similar to case N = 2, we have 



and W(t) :-- 



ii' 



dW p {t) 
dt 



< pWP(t)M+ Q [F-3D] 

< pW p (t) sup fi P:Q (J F (x,y,z) 

(x,y,z)eV 



3D) 



which leads to 



where c = sup /j, Pi q (Jf(%, U, z 

(x,y,z)eV 



W p (t) < e pct W p (0), 

3D) . Taking the pth roots, 



-l l 

1 -2 
1 



with the 



W(t) < e ct W(0). 

The second graph has the graph Laplacian matrix L 
following ODE system: 

x = F(x) + D(y - x) 

y = F(y) + D{x -2y + z) 

z = F(z)+D(y-z). 

Note that the smallest positive eigenvalue of —L is A = 1. Let again for a fixed 



Then 

dW p {t) 
dt 



,y, 


z), w(t) 


= (||x- 


-y\\ P ,c 


h \\y~ z \ 


P,Q> \\ x - z\\ p ,q) and W{t) = \\ 






\qi(xi - 




~ 2 qi{xi - 


Vi)qi(xi - m) 


+ 


P2Zi=x 


h(yi - 




~ 2 qi(yi - 


Zi)qi(yi - Zi) 


+ 




\qi(xi - 


*)[*- 


~ 2 qi(xi - 


Zi)qi(xi ZjJ 






\qi(xi - 


Vi)\ p - 


~ 2 qt(xi - 


y i )q i (F l (x)-F i (y)-2D i (x i 


+ 




\qi{vi - 


zi)r 


~ 2 qi{yi - 


z l )q l {F i {y)-F i (z)-2D l {y i - 


+ 




\qi{xi - 


z,)t 


~ 2 qi(xi - 


Zi)q% ( F i(, x ) - Fi(z) - Di(xi - 



w 



V 



Zi))- 
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By Lemma O 

n n n n 

^2 \ x i-yi\ p ~ 2 ( x i-yi)(yi~ z i)+^2 \yi- z i\ p ~ 2 (yi- z i)( x i-yi) ^ \ x i-yi\ p +^2 \ yi ~ 

8=1 8=1 8=1 1 = 1 

Hence 

- pYa=i h( x i - yi)\ p ~ 2 Qi( x i - Vi)Qi (Fi(x) - Fi(y) - AOi - y t )) 

+ pYh=i h(Vi - Zi)\ p ~ 2 qi{yi - Zi)qi (i^(y) - Fi(z) - - Zi)) 

+ pYh=i \n( x i - Zi)\ p ' 2 qi(xi - Zi)qi (-Fj(x) - Fi(z) - D^Xi - Zi)) . 

< P WP(t)M+ Q [F - D] 

< pW p (t) sup fi p>Q (J F (x,y,z) - D). 

(x,y,z)£V 

Similar to the previous case: 

W(t) < e ct W{0), 
where in this case c = sup [i P: q (Jf(x, y, z) — D) . 

(x,y,z)eV 



8 Appendix 

8.1 Proof of Theorem CD 

To prove the theorem we need the following 

Proposition 6. J23J/ Let X, Y be arbitrary sets and let ip : X x Y — > R be an 

arbitrary function. For any y E Y and c£R, denote H y>c = {x € X : <p(x, y) > 
c} and C the set of all real numbers c such that for any y € 1" , H y<c ^ and let 
c* = supC. Then 

(B =) sup inf tp(x,y) = inf sup (p(x, y)(= J) 
if and only if for every c < c* , O H yc ^ 0. In this case B = J = c* . 

y& 

A proof can be found in [33] . We provide a proof next. First we need the following 
Lemma 14. For any fixed y £Y , if c\ < C2 then H y ^ C2 C H yci . 

Proof. Pick any x € H ViC2 . By the definition of H y ci , (p(x,y) > C2 > c\ and 
hence x € H y Cl . □ 

Corollary 5. If c\ < C2 then Hy )C2 C j^j H ytC1 . 

y& y&Y 

Proof of Proposition [6]. First we assume that for every c < c*, ^ H V)C ^ 0. 

Using this assumption we'll show that B = J = c* . To this end we'll show the 
following three inequalities: 
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1. B < J. 

<p(x,y) < supcp(x,y) \/x,y 

x&X 

=4> inf (p(x, y) < inf sup ip(x, y) Vx 
=^ sup inf ip(x,y) < inf sup f(x,y). 

Hence by the definition, B < J. 

2. J < c* . For an arbitrary c > c* we'll show that J < c and then we can 
conclude that J < c* . Since c > c* , there exists yo G Y such that -ff yo , c = 
(otherwise c G C and so c < c*). This means that for all x € X, ip(x, yo) < c 
which implies sup ip(x, yo) < c and hence J = inf sup yo) < c. 

x^X V& x€X 

3. c* < -B. For an arbitrary c < c* we'll show that B > c and then we 
can conclude that B > c* . Since c < c* , there exists cq G C such that 
c < co (otherwise c = supC). Since we assumed that for every c < c*, 
|^| i7y iC 7^ 0, and since Co < c*, Co € C, we have |^| -ffy, Co 7^ 0- By 

Corollary [5j because c < cq, then O flj, )C 7^ 0, i.e. there exists xo G X 

such that for all y G V, (p(xo,y) > c, which implies inf (p(xo,y) > c and 
hence -B = sup inf (p(x, y) > c. 

Now we suppose B = J and fix c < c*. We'll show that O -By jC 7^ 0- Since 

yey 

c < c*, there exists Co € C such that c < Co- This means that there exists xo £ X 
such that for all y & Y, (p(xo,y) > cq, i.e. J > co- Since J = B, there exists 
£1 G X such that for all y G Y, (p(xi,y) > cq > c, i.e. O ii/^c 7^ 0. □ 

yey 

For a fixed arbitrary norm || • || on M. nN and a fixed arbitrary matrix A G jj™NxnA^ 
define ip : S^" 1 x (0, 1) ->• R by 

= -(||« + Mv|| -1), 

where 5 n7V_1 = {v G R nN : \\v\\ = 1}. For any h G (0,1) and c G R, let 
^ft,c = gn-N-i . tpfy^ fij > c } anc l let C be the set of all real numbers c such 
that H h c 7^ whenever h G (0, 1). Let c* = supC. 

Lemma 15. cp(v, h) = t(\\ v + hAv\\ — 1) is non-increasing as h — > + . 
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Proof. Let a < 1. Since \\v\\ = 1, 

(p(v,ah) = — - (\\v + ahAv\\ — 1) 
ah 

1 f„v . 1 



- ||- +fcAu|| 

n V a a 

- syKi-'J + t' + ^H-^-D-i 
< T(ll(^-«)ll + ll(» + Mf,)||-(i-i)-i 

= -(||u + 7iAt;|| -1) 
= <p(v,h). 

□ 

Corollary 6. For any matrix A, — (||/ + /l<4|| — 1) is non-increasing as h — > + . 

Proof. Let a < 1. By the definition of norm of a matrix and Lemma [T5l 

— (\\I + ahA\\-l) = sup — (|b + ahAv\\ - 1) 
a/i IMI=i a "' 

= sup tp(v,ah) 

\\v\\=l 

< sup /l) 

||u||=i 

= I(||/ + ^||-l). 



/? 



□ 



Proof of Theorem [TJ Claim 1. 



sup inf ip(v,h) = inf sup (p(v,h). 

v £gnN-l h£(0,l) h£(0,l) v £gnN-l 

Proof of Claim 1. To apply Proposition[6j we'll show that for c < c*, O H/i iC 7^ 

h6(0,l) 

0, where Hh^ c = {v € 5' nAr ~ 1 : h) > c} and c* is defined as above. By Lemma 
[T5l ^(u, /i) is decreasing in h which implies -ff/i ljC C -ff/i 2 ,c when /ii < /12. Also by 
the definition of c*, c < c* implies that -ff/^c 7^ for any /i E (0, 1). On the other 
hand, each H^^ is a closed subset of S nN ~ l , so they are all compact. Hence their 
intersection is non-empty. 

Claim 2. 



and 



sup lim tp(v, h) = sup inf ip(v, h) 



lim sup ip(v,h) = inf sup ip(v,h). 

h— »0+ ^ggniV-l /lG(0,l) „ggniV-l 



Proof of claim 2. By Lemma I15| since f(v,h) is non-increasing as h — > + , 
sup lim ip(v,h) = sup inf ip(v,h). By Corollary [6j since — (||/+/iA|| — 

ue<S nJV-1 h^-0+ „g5"njv-i h€(0,l) h 
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1) is non-increasing as h —> + , lim sup <p(v,h) = inf sup Lp(v,h).~By 

claim 1, the right hand side of the equalities in Claim 2 are equal, and therefore 
so are their left hand sides: 

sup lim tp(v,h) = lim sup ip(v,h), 

v ^gnN-i h— S-0 + h— K)+ ^ggniV-l 

which implies n{A) = sup lim — (\\v + hAv\\ — 1). □ 
IM|=i h->-o+ h 



8.2 Proof of Lemma O 

Proof. Fix p < q. Then there exists r > such that — I — = — . Indeed 

q r p 

r = j j-. Using Holder's inequality, 

p ~ g 

i i.i 

i/rV < (f \f\ q ) 9 ( 1 1 
< (/ i/i«)>|H 

Hence F is an increasing function of p. Now we'll show that as p — > oo, F(p) — > 
H/lloo- Note that for any p, -F(p) < ||/||oo and therefore lim F(p) < ||/||oo- To 

p— ^oo 

prove the converse inequality, for any e > 0, we define E e := {uj G : |/(w)| > 
e} which by the definition of ||/||oo nas positive measure, i.e. \E e \ > 0. 

i i 
p if, \ p 

\EJ\p 



\f\ P > [ \f\ P 
> (ll/lloo-e 
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\EJ _ /LELl\i 



But because — — - > 0, ) 1 as p -> oo. Therefore for any arbitrary 

e > 0, 



which implies 



lim F(p) > ll/IU-e, 

p— »oo 



lim -F(p) > 

p— ¥00 



□ 
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